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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

A request for continued examination under 37 CFR 1.1 14, including the fee set forth in 
37 CFR 1 .17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicant's submission filed on 1/21/09 has been entered. 

Response to Amendment 

1 . This office action is in response to an amendment filed on 1/2 1/2009. 

2. Claims 1 and 5 have been amended by the applicant. 

3. Claims 2, 4, 6 and 8 are original. 

4. Claims 3 and 7 have been cancelled. 

Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as sol forth in section ! 02 of this title, if 
the differences between the subject matter sought to be patented and the prior art are such that the .subject matter a.s a whole would 
have been obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1, 2, 4-6 and 8 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Lee et al. (hereinafter "Lee", "Fast head modeling for animation") in view of Migdal et al. 
(hereinafter "Migdal", US Patent 6,208,347). 
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Regarding claim 1 , Lee teaches a computer-implemented method of reconstructing a 
regular 3D model by feature-line segmentation (pg. 1 1 st | lines 1-5: "...a method to reconstruct 
3D facial model for animation... based on extracting features on a face... and modifying a 
generic model with detected feature points.' 1 , Fig. 1), comprising using a computer to perform the 
steps of: 

(a) inputting original 3D model data (sec. 2.1 3 rd ^ lines 1-4: "...camera is used to 
generate range data of faces. We can convert some part of the range data in VRML format to 
appropriate to our need as input if necessary. We visualize the range data in front view as it is 
and rotate and translate to show the right and left views together as shown in Figure 3", where 
3D VRML range data input shown in Fig. 3(a) is initially collected from cameras to provide 
three-dimensional model data); 

(b) drawing 3D feature-lines according to the original 3D model data and user 
requirements (sec. 2.2. 1 1 st *[f lines 1-3: ". . .to fit a contour. ..we move a few points to the 
corresponding position interactively. . ." and is shown in progression from Fig. 3(a) to Fig. 3(b)); 

(c) converting the 3D feature-lines into continuing 3D threads (Figs. 2 & 3(b)) wherein 
the 3D threads are composed of connection joints, connection lines, and loops (pg. 3 sec. 2.2 1 st ]f 
lines 6-9: "To get correspondence between points from. ..points on a generic model. . .a snake is a 
good candidate... we add some more functions... as structure snake. Fig. 3(b)), wherein the 
connection joints are intersection points of the 3D feature-lines, the connection lines are the 3D 
feature-lines between two connection joints (Fig. 3(b)), and the loops are closed zones 
constructed by the connection lines (pg. 3 sec. 2.2 1 st If lines 6-9: "To get correspondence 
between points from pictures and points on a generic model, which has a defined number, a 
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snake is a good candidate. Above the conventional snake, we add some more functions called as 
structure snake, which is useful to make correspondences between points on a front view and 
ones on a side." and Figs. 3(b) & 4(b), providing a snake forming a loop outlining an outer 
shape of the model 's feature lines, Fig. 2); 

(e) producing a regular triangular grid sample model according to the continuing 3D 
threads (Fig. 5(a)); and 

(f) projecting the regular triangular grid sample model into the original 3D model to 
produce a reconstructed 3D model (pg. 6 sec. 2.3.2 1 st H lines 1-6 - pg. 7 lines 1-9: "...to get 
accurate positions... We collect feature points... of corresponding points on original range data. 
Then we calculate Voronoi triangles of chosen feature points... The Voronoi triangles and 
collected points on a surface are shown in Figure 5 (a) ...Then ...projection of points are used... to 
get the corresponding accurate coordinate in a range data. ..Figure 5 (c) is the final result. . .", 
where the captured feature points forming the triangular grid of 'Fig. 5(a) are projected onto the 
original range data, pg. 3 sec. 2. 1 3 rd U lines 1-4: ". . .camera is used to generate range data of 
faces. We can convert some part of the range data in VRML format to appropriate to our need as 
input if necessary. We visualize the range data in front view as it is and rotate and translate to 
show the right and left views...", in order to generate the reconstructed model of 'Fig. 5(c)). 
However, Lee fails to teach determining sample numbers of each connection line, adding or 
deleting the loops, and outputting the 3D threads, redetermining the number of sample points on 
each connection line, readding or redeleting the loops, and repeating steps (e) and (f) if the 
reconstructed 3D model does not satisfy resolution requirements from the user, and outputting 
the reconstructed 3D model if the reconstructed 3D model satisfies the resolution requirements 
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and wherein the sample points for the reconstructed 3D model are located on the connection 
lines despite of the number of sample points; 

Migdal teaches (d) determining sample numbers of each connection line, adding or 
deleting the loops, and outputting the 3D threads (col. 22 lines 38-47: ". . .as 6D data points are 
added to or removed from the mesh, the faces of the mesh change. When those faces are 
changed, values calculated for any 6D data points associated with the face can change. . . When 
such alterations occur, the computer system 3 must calculate new values for the affected 6D data 
points or rearrange their associations with particular mesh faces." and in col. 27 lines 8-40: 
". . .computer system 3 of the present invention can fully ...describe ...the basic shape 
contours. ..of an object with relatively few selected points. ..data points obtained from a laser 
scan of a person's face can be typically simplified... which describe the contours... with good 
resolution... incrementally adding... points of detail from the mesh until the mesh meets the 
resolution set by the user's specification...", where the number of points, or density, that 
comprises the interconnecting lines and loops of the mesh is determined as vertices are added 
and deleted); and 

(g) redetermining the number of sample points on each connection line, readding or 
redeleting the loops, and repeating steps (e) and (f) if the reconstructed 3D model does not 
satisfy resolution requirements from the user, and outputting the reconstructed 3D model if the 
reconstructed 3D model satisfies the resolution requirements (col. 27 lines 8-40: ". . .computer 
system 3 of the present invention can fully approximate, describe and reproduce both the basic 
shape contours and color details of an object with relatively few selected points... data points 
obtained from a laser scan of a person's face can be typically simplified from an initial set of 
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100,000 data points to a mesh of a few thousand data points which describe the contours and 
color details with good resolution... incrementally adding... points of detail from the mesh until 
the mesh meets the resolution set by the user's specification..." and in col. 9 lines 23-29: ". ..the 
present system and method maintains an optimal structure at all times during "up resolution " or 
"down resolution " mesh construction... Optimal construction refers to the "connectivity" of the 
mesh or the interconnection of the edges that join the data points and define the geometric 
primitives of the mesh...", where the density of the points comprising the contour lines, or 
connection lines, of the mesh are continually incrementally calculated or redetermined until the 
desired resolution is reached); 

wherein the sample points for the reconstructed 3D model are located on the connection 
lines despite of the number of sample points (col. 27 lines 8-21 : ". . .computer system 3 of the 
present invention can fully approximate, describe and reproduce both the basic shape contours 
and color details of an object with relatively few selected points. As more detail is required, a 
system following the up resolution selection principle can add more details by simply adding the 
next most significant points... data points obtained from a laser scan of a person's face can be 
typically simplified from an initial set of 100,000 data points to a mesh of a few thousand data 
points which describe the contours and color details with good resolution." and col. 9 lines 23- 
29: ". ..the present system and method maintains an optimal structure at all times during "up 
resolution" or "down resolution" mesh construction... Optimal construction refers to the 
"connectivity" of the mesh or the interconnection of the edges that join the data points and define 
the geometric primitives of the mesh. . .", where the sampled points remain on the connection or 
contour lines that provide the shape of the reconstructed model are maintained regardless of the 
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changes in resolution of the model). Therefore it would have been obvious to one of ordinary 
skill in the art at the time of invention to modify the snake connection lines of Lee with the 
determined number of connection sample points provided by Migdal because this modification 
would provide efficient reconstruction of a 3D model through acquiring particular feature points, 
instead a large amount of mesh data, and producing a reconstructed 3D model from a regular 
grid formed based on the feature points, whereby the structure of the 3D model is efficiently 
maintained using connection lines despite changes to the mesh surface. 

Regarding claims 2 and 6, Lee teaches that the 3D feature-lines are based on the exterior 
appearance and structure of the original 3D model (pg. 2 2 nd lines 1-4: ". ..a fast method 
applied to two kinds of input to get an animatable cloning of a person... feature detection is 
described to get rough shape of a given face from orthogonal picture data or range data... 11 , and 
in Fig. 1 : transition from range data to the feature extraction section, where the features of the 
outer structure of the 3D model is captured). 

Regarding claims 4 and 8, Lee illustrates combining the closed regular triangular grids of 
the loops as the regular triangular grid sample model (Fig. 5(a)). However, Lee fails to teach 
constructing regular triangular grids in each loop according to the sample points of each 
connection line in step (d). Migdal teaches constructing regular triangular grids in each loop 
according to the sample points of each connection line (col. 27 lines 22-26: ". ..incrementally 
adding 6D points of detail from the mesh until the mesh meets the resolution set by the user's 
specification, or until the mesh is created to the highest density. . ." and in col. 9 lines 23-29: 
"...the present system and method maintains an optimal structure at all times . . . Optimal 
construction refers to the "connectivity" of the mesh or the interconnection of the edges that join 
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the data points and define the geometric primitives of the mesh (e.g., the triangular mesh...", 
where points are incrementally inserted into the triangular grid, which provides continual 
generation of a mesh, as produced in step(d) of claim 1, based on the density or number of 
sample points of the mesh, as shown in the progression from Figs. 2c to 2d). Therefore it would 
have been obvious to one of ordinary skill in the art at the time of invention to modify the 
reconstructed 3D model of Lee with the mesh model resolution procedures of Migdal because 
this modification would provide accurate reconstruction of a 3D model through acquiring feature 
points, instead a large amount of mesh data, and producing a reconstructed 3D model from a 
regular grid formed based on the feature points, whereby the structure of the 3D model is 
efficiently maintained despite changes to the mesh surface. 

Regarding claim 5, Lee teaches a computer-implemented method of reconstructing a 
regular 3D model by feature-line segmentation (pg. 1 1 st U lines 1-5: "...a method to reconstruct 
3D facial model for animation... based on extracting features on a face... and modifying a 
generic model with detected feature points", Fig. 1), comprising using a computer to perform the 
steps of: 

inputting original 3D model data (sec. 2. 1 3 rd U lines 1-4: ". . .camera is used to generate 
range data of faces. We can convert some part of the range data in VRML format to appropriate 
to our need as input if necessary. We visualize the range data in front view as it is and rotate and 
translate to show the right and left views together as shown in Figure 3", where 3D VRML 
range data input shown in Fig. 3(a) is initially collected from cameras to provide three- 
dimensional model data); 



Application/Control Number: 10/623,646 Page 9 

Art Unit: 2628 

drawing 3D feature-lines according to the original 3D model data and user requirements 
(sec. 2.2.1 1 st T( lines 1-3: "...to fit a contour. ..we move a few points to the corresponding 
position interactively. . ." and is shown in progression from Fig. 3(a) to Fig. 3(b)); 

converting the 3D feature-lines into continuing 3D threads wherein the 3D threads are 
composed of connection joints, connection lines, and loops (pg. 3 sec. 2.2 1 st \ lines 6-9: "To get 
correspondence between points from. ..points on a generic model. . .a snake is a good 
candidate... we add some more functions... as structure snake. . .", Fig. 3(b)), wherein the 
connection joints are intersection points of the 3D feature-lines, the connection lines are the 3D 
feature-lines between two connection joints (Fig. 3(b)), and the loops are closed zones 
constructed by the connection lines (pg. 3 sec. 2.2 1 st \ lines 6-9: "7b get correspondence 
between points from pictures and points on a generic model, which has a defined number, a 
snake is a good candidate. Above the conventional snake, we add some more functions called as 
structure snake, which is useful to make correspondences between points on a front view and 
ones on a side." and Figs. 3(b) & 4(b), providing a snake forming a loop outlining an outer 
shape of the model's feature lines, Fig. 2); 

producing a regular triangular grid sample model according to the 3D threads (Fig. 5(a)); 

and 

projecting the regular triangular grid sample model into the original 3D model to produce 
a reconstructed 3D model (pg. 6 sec. 2.3.2 1 st K lines 1-6 - pg. 7 lines 1-9: "...to get accurate 
positions ...We collect feature points... of corresponding points on original range data. Then we 
calculate Voronoi triangles of chosen feature points... The Voronoi triangles and collected points 
on a surface are shown in Figure 5 (a) ...Then... projection of points are used... to get the 
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corresponding accurate coordinate in a range data... Figure 5 (c) is the final result. ..", where 
the captured feature points forming the triangular grid o/Fig. 5(a) are projected onto the 
original range data, pg. 3 sec. 2.1 3 rd K lines 1 -4: ". . .camera is used to generate range data of 
faces. We can convert some part of the range data in VRML format to appropriate to our need as 
input if necessary. We visualize the range data in front view as it is and rotate and translate to 
show the right and left views...", in order to generate the reconstructed model o/Fig. 5(c)). 
However, Lee fails to teach determining a number of sample points on each connection line, 
adding or deleting the loops, outputting the 3D threads, wherein the sample points for the 
reconstructed 3D model located on the connection lines despite of the number of sample points; 

Migdal teaches determining sample numbers of each connection line, adding or deleting 
the loops, and outputting the 3D threads (col. 22 lines 38-47: "...as 6D data points are added to 
or removed from the mesh, the faces of the mesh change. When those faces are changed, values 
calculated for any 6D data points associated with the face can change. . . When such alterations 
occur, the computer system 3 must calculate new values for the affected 6D data points or 
rearrange their associations with particular mesh faces", col. 27 lines 8-40: ". . .computer 
system 3 of the present invention can fully. ..describe. ..the basic shape contours... of an object 
with relatively few selected points ...data points obtained from a laser scan of a person's face can 
be typically simplified. ..which describe the contours... with good resolution... incrementally 
adding... points of detail from the mesh until the mesh meets the resolution set by the user's 
specification...", where the number of sample points, or density, that comprise the contour 
connection lines and loops of the mesh are determined as vertices are added and deleted); 
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wherein the sample points for the reconstructed 3D model are located on the connection 
lines despite of the number of sample points (col. 27 lines 8-21 :". . .computer system 3 of the 
present invention can fully approximate, describe and reproduce both the basic shape contours 
and color details of an object with relatively few selected points. As more detail is required, a 
system following the up resolution selection principle can add more details by simply adding the 
next most significant points ...data points obtained from a laser scan of a person's face can be 
typically simplified from an initial set of 100,000 data points to a mesh of a few thousand data 
points which describe the contours and color details with good resolution." and col. 9 lines 23- 
29: ". . .the present system and method maintains an optimal structure at all times during "up 
resolution" or "down resolution" mesh construction .. .Optimal construction refers to the 
"connectivity" of the mesh or the interconnection of the edges that join the data points and define 
the geometric primitives of the mesh. . .", where the sampled points remain on the connection or 
contour lines that provide the shape of the reconstructed model are maintained regardless of the 
changes in resolution of the model). Therefore it would have been obvious to one of ordinary 
skill in the art at the time of invention to modify the reconstructed 3D model of Lee with the 
mesh model resolution procedures of Migdal because this modification would provide accurate 
reconstruction of a 3D model through acquiring feature points, instead a large amount of mesh 
data, and producing a reconstructed 3D model from a regular grid formed based on the feature 
points, whereby the structure of the 3D model is efficiently maintained despite changes to the 
mesh surface. 
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Response to Arguments 

Applicant's arguments filed 1/21/09 have been fully considered but they are not 
persuasive. 

The applicant argues on pg. 8 3 rd H line 8 - pg. 9 1 st U line 7 of the remarks that in regards 
to claims 1 and 5 Lee fails to teach determining a number of sample points on each connection 
line, and unlike Lee, the sample points are obtained form the connection lines in the present 
invention. However, in response to applicant's arguments against the references individually, one 
cannot show nonobviousness by attacking references individually where the rejections are based 
on combinations of references. See In re Keller, 642 F.2d 413, 208 USPQ 871 (CCPA 1981); In 
re Merck & Co., 800 F.2d 1091, 231 USPQ 375 (Fed. Cir. 1986). 

The applicant argues on pg. 9 2 nd \ lines 8-9 of the remarks that in regards to claims 1 and 
5, Migdal fails to teach determining a number of sample points on each connection line. 
However, Migdal teaches a plurality of sample points are determined for each connection line 
(col. 27 lines 8-40: "...the present invention can fully ...describe... the basic shape contours. ..of 
an object with relatively few selected points... data points obtained from a laser scan of a 
person's face can be typically simplified... which describe the contours ...with good 
resolution... incrementally adding... points of detail from the mesh until the mesh meets the 
resolution set by the user's specification...''', in which various sample points from the facial 
contours are determined to provide a particular resolution, which is the number of sample 
points, as disclosed in applicant's Specification pg. 6 lines 23-25) therefore the 35 U.S. C. 103(a) 
rejection of claims 1 and 5 has been maintained. 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to SAID BROOME whose telephone number is (571)272-2931. 
The examiner can normally be reached on M-F 8:30am-5pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ulka Chauhan can be reached on (571)272-7782. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Said Broome/ 
Examiner, Art Unit 2628 

/XIAO M. WU/ 

Supervisory Patent Examiner, Art Unit 2628 



